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— The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment See 37 CFR 1.704(b). 

Status 

1 )[x] Responsive to communication(s) filed on 19 November 2001 . 
2a)D This action is FINAL. 2b)[X] This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) [X] Claim(s) 1-17 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) [X] Claim(s) 1-17 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)Q The drawing(s) filed on is/are: a)Q accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)Q Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Specification 

1. The disclosure is objected to because of the following informality: page 6, line 24, "by" 
should be changed to -be--. 

Appropriate correction is required. 

Drawings 

2. The drawings are objected to because in Fig.2, step 205, "RECONGNIZES" should be 
changed to --RECOGNIZES-- and step 250, "SYSTEMS" should be changed to -SYSTEM-- 
Corrections are required. 

Claim Rejections - 35 USC §102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21 (2) of such treaty in the English language. 

4. Claims 1-17 are rejected under 35 U.S.C. 102(e) as being anticipated by Maruno et al. 
("Maruno", US 6,191,773). 

As per claim 1, Maruno teaches a video display device comprising: a display configured 
to display a plurality of selection options (Fig.l, col. 4, lines 32-40, displaying a plurality of 
selection options such as menu 201, 202); a processor operatively coupled to the display and 
configured to sequentially highlight each of the plurality of selection options for a period of time 
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and configured to receive a selection gesture from the user for selecting a highlighted selection 
option (col.l, lines 40-55, indicating display objects sequentially by hand movement 
recognition). 

As per claim 2, Maruno teaches the video display device wherein the processor is 
configured to highlight each of the plurality of selection options by causing the display to display 
one of each of the plurality of selection options for the period of time (Fig.l, highlighted display 
of each one of the plurality of selection options such as menu 201). 

As per claim 3, Maruno teaches the video display device wherein the processor is 
configured to highlight each of the plurality of selection options by causing the display to alter a 
display characteristic for one of each of the plurality of selection options for the period of time 
(Fig.l, selected menu 201 is highlighted to distinguish it from menu 202). 

As per claim 4, Maruno teaches the video display device comprising an audio output 
device, wherein the processor is configured to highlight each of the plurality of selection options 
by causing the audio output device to sequentially output an audio indication associated with a 
corresponding one of each of the plurality of selection options (col. 5, lines 31-45, using sound or 
voice from the display device in tune with the emphasis display). 

As per claim 5, Maruno teaches the video display device of claim 1, comprising a camera 
operatively coupled to the processor for acquiring an image of the user containing the selection 
gesture (Fig.l, CCD camera 3, col.4, lines 33-34). 

As per claim 6, Maruno teaches the video display device wherein the image information 
is contained in a plurality of images and wherein the processor is configured to analyze the 
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plurality of images to determine the selection gesture (Fig.2, lines 40-54, shape identifying 
means analyzes images to determine selection gesture). 

As per claim 7, Maruno teaches the video display device wherein the image information 
is contained in a plurality of images and wherein the processor is configured to determine the 
selection gesture by analyzing the plurality of images and determining a trajectory of a hand of 
the user (Fig.4, lines 40-54, shape identifying means analyzes the plurality of hand images and 
calculates the image difference of the trajectory of the hand). 

As per claim 8, Maruno teaches the video display device wherein the processor is 
configured to determine the selection gesture by analyzing an image of the user and determining 
a posture of a hand of the user (Fig.4, col.4, line 67- col. 5, line 30, contour depicting unit 222 
depicts the posture of a hand of the user). 

As per claim 9, Maruno teaches the video display device wherein the video display 
device is a television (col.l, lines 7-10, display such as a television). 

As per claim 10, Maruno teaches a method of providing a user interface containing a 
plurality of selection options, the method comprising the acts of: displaying a plurality of 
selection options (Fig.l, col.4, lines 32-40, displaying a plurality of selection options such as 
menu 201, 202); highlighting each one of the plurality of selection options sequentially (col.l, 
lines 40-55, indicating display objects sequentially by hand movement recognition); analyzing an 
image of the user to determine whether the image contains a selection gesture for a highlighted 
selection option (Fig.2, lines 40-54, shape identifying means analyzes images to determine 
selection gesture). 
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Claims 11-13, and claims 15-17 are similar in scope to claims 6-8 respectively and 
therefore are rejected under similar rationale. 

Claim 14 is similar in scope to claim 10 and therefore is rejected under similar rationale. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Maruno et al. (US 6, 191,773) teaches interface apparatus 

Lee et al. (US 6,160,899) teaches method of application menu selection and activation 
using image cognition 

Iwamura (US 6,498,628) teaches motion sensing interface 

Kumar et al. (US 6,204,852) teaches video hand image three-dimensional computer 
interface 

Hongo (US 6,677,969) teaches instruction recognition system having gesture recognition 
function 

Inquiries 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Anh Nguyen whose telephone number is (703) 305-8649. The 
examiner can normally be reached on Monday - Thursday from 6:00 am to 3:30 pm (EST) and 
alternate Fridays. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine Kincaid, can be reached on (703) 308-0640. 
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The fax number for the organization where this application or proceeding is assigned is 
(703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 



Anh T Nguyen 
Examiner 
Art Unit 2174 




